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INFERRING FINITE-TIME PERFORMANCE 
IN THE M/G/1 QUEUEING MODEL 

P . A . J acobs 
D . P . Gave r 



1 . INTRODUCTION AND SUMMARY 

The M/G/1 model for a single server approached by a Poisson (A) srream 
of arrivals wit:h independent: but: ot:herwise arbit:rarily distributed serv'ice 
times is a standard tool in operations research. It has been used to 
model situations occurring in road traffic, computer and communication 
performance evaluation and the military’, and has been modified to 
accommodate priorit\’ and server breakdown situations, as well as both 
heavy and light traffic situations (p = AE [S] either near, but be 1 ou . 
unity, and near, but above, zero). 

Although the M/G/1 model is rather simplistic, little beyond the 
moments of its long-run or steads'- state distribution are easils available 
in an>'thing like closed (and simple) anals'tical form readily evaluated 
numerically. In the case of the exponential service time M/M/1 ssstem. 
the complete analytical solution for transition probab i 1 i st i es in terms of 
series of Bessel functions has been long known, and numerical transform 
inversion by Middleton (1979) has provided some useful tables describing 
the manner in which steady state is approached. Recent work of Abate and 
Whitt (1989,1988) provides some handy approximations, particularly in the 
M/M/1 case. The work of Asmussen and Thorisson (1988) and New-ell (1971, 
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19S2) furnishes diffusion approximations and heavy traffic results as 
we 1 1 . 

In this paper we explore the following operationally relevant 

Probl em : A single server is approached by a stream of arrivals to be 
modelled as Poisson. One has available a sample of service times obtained 
by observing the system. Using the arrival rate (assumed known, at least 
initially) and the observed service times, estimate the expected waiting 
time encountered by a new arriving customer at finite time t. Further- 
more, provide an assessment of estimation uncertainty, e.g. confidence 
1 imits . 

The abov'e is just one prototypical question to be asked--it is the one 
addressed in this paper. Other questions could concern the probability 
that an arrival at t will wait for at least time w, or that the customer 
waiting time has never exceeded w in time t (starting from an empty 
s\'stem) . There are many other such measures of system performance that 
are relevant. Ve concentrate here on inferring the mean waiting time at 
finite time t, and do so non -parametr i cal ly , i.e. without specifying, and 
estimating parameters in a small conventional parametric family such as 
the Gamma. Our approach is to work with the well-known Laplace trans- 
form of the mean (virtual) waiting time for the M/G/1 system: cf . Takacs 

(1962) and Gaver and Jacobs (1987), an emp i ri cal version of which can be 
obtained by utilizing the empirical transform of the busy period, itself 
depending upon the empirical transform of the service time df , derived 
from the observed data. 

We look upon our present results as exploratory and tentative, but of 
an accuracy useful until refinements are available. 
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A recent paper b\* Tengels (1988) provides mathematically rigorous 
as\'mptotic (large sample size) treatment of certain aspects of our 
nonparame t r i c inference problem. Application of bootstrap methods, cf . 
Efron (1979) can yield further insights into the inference at the price of 
computer i nt e ns i v i t\' . 
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MATHEMATICAL FORMULATION 



Consider an M/G/l queue wit:h known arrival rare A and independent: 
idenricall\' distributed service times, S, having nth moment E [S^] < oc . 

Suppose there are no customers either waiting or being served at time 0. 

Let be the virtual waiting time at time t and put (conditional on 

Wo = 0) 

fOC 

dt , s > 0 . (1) 

•’o 

We know that 

'•w(s) = - -~2 ^ + Poo(s) J ; (2) 

S 

where : 



Poo(^) 



1 ^ 

s + - b(s)] ’ 



(3) 



b(s) being the Laplace transform of a busy period duration; b(s) is the 
smallest positive solution of 

b(s) = Fs(s + A (1 - b(s))) ; (4) 



F 5 is the Lap 1 ace-St i e 1 t j es transform of the service time. See Takacs 
(1962) and Gaver and Jacobs (1986). 

Two approximations to E [W^ | W'q = 0] will be detailed below; one for the 
case of the traffic intensity AE [S] < 1 ; the other for the case of the 
traffic intensity AE[S] > 1 . Both are based on the transforms (2), (3), 
and (4) . 
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3. APPROXIMATIONS FOR STABLE QUEUES : EXPONENTIAL APPROACH 

In t:his subsection, it is assumed that p = AE [S] <1. In this case 

there is a limiting expected virtual waiting time 



- _ , r-r.. T _ AE[S^] 

Ucc - - 2(1 - p) ’ 



w’ i th 



P = AE[S] , 



(5 



( 6 ; 



the traffic intensity. 

Our choice of the form of the approximation is based on an observation 
of Odoni and Roth (19S3) , and on relatxation time calculations made b\' 
Keilson (1979), Newell (1971) and others. The explicit approximation of 
the exponential: 



E W. 



V^(l - 



■) 



- E[^Vt] 



-3i 



(-J 



It should be noted that in many cases the exponential approach to the 

limiting value is not exact, being only an approximation, cf . Asmussen and 
Thorissan (19S8). Setting 



F 1 W 

se'St ^1, ~ dt = - 

V. Y 



•Ji . 

se e dt 



(S) 



we obt a i n 



Sl/>W(S) - W; 



V>;C S + 0 



(9) 



which is now solved for 0 at selected s-values: 



1 + He) = 



S ( S ) - Uqc 
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so 



srl') = -Wqc - [s«’w(s)^- Wx] 

® svv^(s) - Woe 



F inal Iv 



0 = 



(S) 



Sl>'w ( ^ ) “ ^ oo 

The approx i mat: i on t:o E[W^] is 



E[WJ Voo(l - , 



( 10 ) 



( 11 ) 



( 12 ) 



where 2 is evalua1:ed as above at: s = lx. 1:urns ou1: t:hat: l:he /?-\'alues so 

obtained are nol: cons1:ant: but: are ( exi: reme 1 %') s 1 ow 1 y- chang i ng functions of 
1: , as should be l:he case from asympt:ot:ic analysis. 

Table 1 repor1:s the values of the approximating E [W^] for an M/M/1 
queue with A = 1 and E [S] = .95. The approximating values are compared to 

values obtained by Middleton (1979), who used a numerical inversion of the 
Laplace transform To Stehfest (1970). The approximation is very- 

good for the times less than or equal to 100. For the times greater than 
100 the approximation is within 11% of the true, and conservatively- 
slightly- overestimate of the true mean. 
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Table 1 



Exponential Approximation 
M/M /I Queue: A = 1, E [S] = .95 



T ime 


True 


Exponent i a 1 


t 


E[W,] 


App rox i mat ion 


20 


3.9 


3.7 


40 


5.5 


5.4 


60 


CO 

CO 


CO 

CO 


80 


7.4 


7.6 


100 


8.1 


8.4 


400 


13.2 


14.6 


800 


15.5 


17.0 


1200 


16.6 


17.7 


Note: = 18.05 







Table 2 reports the v'alues of the approximating E[U^] for an M/G/1 
queue with A = 1 and gamma service times with shape parameter q = .2 and 

scale parameter 3 = 4.5. Once again the approximation is very good. The 
values of the true E [U/1 are from Middleton (1979). 



Table 2 



Exponenl:ial Approximation 
M/G/1 Queue: A = 1 

Service Time Distribution Gamma shape parameter 
Q = .2, scale parameter 0 = 4.5, E [S] = .90 



Time 


T rue 


Exponent i al 


t 


E[W,] 


Approx i mat ion 


4.9 


2.3 


2.2 


9.7 


3.7 


3.4 


29.2 


6.9 


6.7 


48.6 


8.8 


8.8 


97.2 


11 .9 


12.5 


194.4 


15.3 


16.9 


486 


20.1 


21 .9 


972 


22.6 


23.7 


1458 


23 . 5 


23.8 


1944 


23.9 


24 . 1 



Note: = 24.3 



The numerical results obtained suggest that in general the 
approximation is biased slightly on the high side Tor large t. It is thus 
conservative in the sense that predictions of expected waiting times tend 
to be slightly overstated. 
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4 . THE HEAVY TFLAFFIC EXPONENTIAL APPROXIMATION (HTE) 

The most: computat i onal 1 y- i ntens i ve parr of the exponential 
approximation is the numerical evaluation of the transform of the bus>’ 
period b(s) using equation (4). This computation has been done by search. 
In this section another approximation is described which uses a heavy 
traffic approximation to obtain b(s), and is computationally less arduous. 

Let {B(t)} be a Brownian motion with drift v = AE [S] - 1 and 

infinitesimal variance <r^ = AE [S^] where S is a generic service time. Let 
Tx be the first passage time to state 0 given B(0) = x. Put 

o(s;.x) = . (:3) 

It is known that 

, . a(s)x . 

o(,s :x) = e ' ' (14 



where 



a(s) 




(15) 



Of course this function is explicit and readily evaluated, and no search 
i s needed . 

Approximating the virtual waiting time process by the Brownian motion 
with drift, the proposed approximation for the transform of the bus\- 
period is 

, (16) 



the Lapl ace-St i e 1 j es transform of the service time distribution evaluated 
at q(s) . The remainder of the approximation is the same as the 
exponential approximation. Table 3 shows the values of the heavy traffic 
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approx i mat: i on for t:he M/G/l queue wit:h A = 1 and 
distribution with shape parajneter q = 0.2 (very 
parameter i3 = 4.5. The heavy traffic approximat 
exponential one and tends to overestimate E [W^] . 
approximation is still practically adequate, and 
than is the ‘‘exact” exponential approximation of 



gamma service time 
long-tailed) and scale 
ion is not as good as the 
Howeve r , the 
is far easier to compute 
Sect ion 2 . 



Table 3 

Unsaturated Heavy Traffic Approximation 
M/G/l Queue: A = 1, Gamma Service Times 

Shape parameter q = 0.2, scale parameter 0 = 4.5, E [S] = .90 



T i me 


True 


Hea\'y Traf 


t 


E[W,] 


Approx i mat : 


4.9 


2.3 


2.5 


9.7 


3.7 


3.9 


29.2 


6.9 


7 . 5 


4S.6 


8.8 


9.8 


97.2 


11.9 


13.6 


194.4 


15.3 


17.9 


972 


22.6 


24 . 1 


1944 


23.9 


24.3 


Note : = 24 . 3 
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5. THE BrSV PERIOD APPROXIMATION 

This approach is based on approx i mar i ng rhe rare of approach of rhe 
probabilir\* o an empry sysrem , Pqo(*^) ’ evenrual value. Since rhe 

process of alrernaring busv' and idel periods can be expressed in rerms of 
an alrernaring renewal process, methods of Gaver and Jacobs (1988) can be 
appl i ed . 

Note : 

s • Vw(s) = -■ i - + Poo(s) > (1“) 



where 



Poo(s) = i • 
1 




b f s u 
s -J 



(IS 



and 



Poo (®) 



P{X(t) = OIX(O) = 0>dr 

^0 



(19) 



where X(r) is rhe number of customers waiting or being served at rime r. 
Assume the queue is stable; then 

Un,^ P{X(t) = 0|X(0) = 0} = E:idlel'fEk,y: = 1 - <> ■ 



where Idle is the length of an idle period and Busy is the length of a 

busy period. Approximate as follows focussing on the probabilitv- that the 
system is empty, approximates as follows in terms of the paraumeter 3^: 

P{X(^) = 0|X(0) = 0} « (1 - p) + ; (21) 



from this comes 



E[V,] (p - l)t + (1 - p)^ + ^(1 




e 






) • 



e 






) 



( 22 ) 
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To find : 



Poo(s) 



(1 - p) , p 



(23) 



Poo(s) 






1 1 

" 1 



(24) 



where 

.'EL^k? - ' r-b 

Solving for 0^ results in 



sC(s) p ^ 1] sC(s) \ p 

1 - C(s) ■ 1 - C(s) 



and evaluate at s = ^. 

Table 4 shows values for the busy period approximation for an M/M/1 
queue with X = 1 and p = .95. The approximate values are below the true 
values for most times t. This approximation is not as accurate as is the 
exponential approximation of Section 2, no longer being conservative. 

Table 4 

Bus\' Period Approximation 
M/M/1 Queue 
A = 1 , E[S] = .95 



Time 


True 


Approx i mate 


t 


E[W,] 


E[WJ 


20 


3.9 


4 . 1 


40 


5.5 


5.4 


60 


6.6 


6.3 


80 


7.4 


7.0 


100 


8.1 


7.5 


400 


13.2 


11.6 


800 


15.5 


13.5 


1200 


16.6 


14.6 



(25) 



(26) 
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THE UNSTABLE OR SATUFL\TED QUEUE EXPONENTI AL APPROX I MAT I ON 



Rewriting, we have 

^w(^) = ^ 2 ’h. 



1 - 



( 27 ) 



= P - ^ + 1 



A[1 - b(s)] 



(2 






In this subsection we assume that p > 1, When this is true the 
distribution of the length of the busy period is not honest, and 
b(0) < 1. W'e w'ill w'rite b(0) b^(s) = t>(0) > w^here b^(s) is now the 

transform of an honest random variable. Now 

1 



/ N P - 1 1 

s stALl-b(O) b^ ( s } j 



(29 



For smal 1 s 



^ w ( ® ) 



p - 1 



A[1 - b(0;] 



(30) 



Thus for large t 



E[W.] » (, - l)t * 



b(0)] 



(31) 



Further 



^w(s) = ^ ~2 ^ io(s) 



(32 



whe re 



b(s) 



1 _ 1 

s + A[1 - b(0)b’^(s)] s + A - Ab(0)b’^(s) 



Multiplying through by s + A yields 



(s + A)d(s) 



or 



1 . 

1 - 
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(33) 



(s - A)o(s) = 1 + (s + A)o(s)|^- ^ b(0)b*(s)J : 



and 



.(.) = b(0)b*(.)<(.) . 



Lerring <p(s) 



^oo 

^0 



f(t)dt 



f(t) = e "'^ + [ f(r-u)h(u)du 

Jo 



where 



7(s) = e’*‘h(t)dt = b(0) ^ ^ ^ b’^(s) 



and 



h(0) = b(0) < 1 . 



Thus f satisfies a re newa 1 -X\'pe equarion w’irh a degenerate 
and it can be shown (cf. Feller (1966)) 

f(t) =5: ce as t -* oc . 

Thus . since 

v^(s) = + 1 0(s) 

s 

E[WJ ^ {p - l)t + £(1 - e"^^) 

as t — oc . Comparing (36) with (31) indicates that 

c _ 1 

/3 ■ A[1 - b(0)] • 



(34) 



(35) 



d istribut ion 



(36) 



(37) 



(3S) 
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as 



In the saturated case the exponential approximation is computed 
f o 1 1 ows : 



E[WJ - (/> - l)t = a (1 - 



where 



a 



A[1 -\(0)] • 



Thus 



-(p-l)t-a_ -01 

a - -e 



(39; 



Taking Laplace transforms 

sv^js) - ( (? ~ ^ ) - a _ _ 1 

' 1 + Hb 



(40j 



which leads to 



-S^Vw(s) (p - 1) 

svw(s) - s - 1 



(41) 



s i nee 



a 



1 

A[1 - b(0)] 



(42) 
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THE SATURATED QUEUE HEAVY TRAFFIC EXPONENTIAL APPROX I MAT I ON 



Once again “the most: arduous comput:at: i on in the saturated queue 
exponential approximation is the computation o*f b(s) , the transform of the 
length of the busy period. As before, an approximation is proposed which 
uses a heavy traffic approximation to evaluate b(s) and b(0). 

Specifically, since u = AE [S] - 1 > 0 let 

a(0) = ^ • (43) 

a 



and 



a(s) 



- 1 / 




+ 2a^s 



(44) 



and put 



b(0) = 



(45) 



and 

b(s) = . 



(46) 



The remainder of the approximation is as in the exponential approximation 
for the saturated queue. 

Table 5 shows results for both the “exact” exponential approximation 
and heavy traffic approximation for a saturated M/G/1 queue with A = 1 and 
gamma service times having shape parameter 0.2 and scale para-meter 7.5 and 
E [S] = 1.5. The true values are from Middleton (1979). As is expected 

the exponential approximation gives values which are closer to the true. 
Both approximations improve as t increases. The exponential approximation 
is very good for all times except the very smallest. 
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Table 5 



Saturated M/G/1 Queue 
A = 1, Gamma Service Times, E [S] = 1.5 

Shape parameter 0.2, Scale paraimeter 7.5 



T i me 


T rue 


Exponent i al 


Heavy Traffic 


t 


E [W J 


Approx i mat ion 


Approx i mat ion 


1 .6 


3.9 


1 .9 


2 . 1 


8.1 


7.5 


7.4 


8.2 


16 . 2 


12.9 


13. 1 


14.4 


27.0 


19.3 


19.7 


21 .6 


43.2 


28.3 


28.8 


31 .3 


54.0 


34.0 


34.6 


37.3 


108. 0 


61 .9 


62.2 


65 . 6 


162.0 


89.1 


89.2 


92.8 


216.0 


116.2 


116.2 


119.8 


324.0 


170.2 


170.2 


173.8 


432.0 


224.2 


224.2 


227 . 8 
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INFERENCE 



The approx i mal: i ons to E[Vj] can be used for inferential purposes b\- 
replacing moment and transforms by sample moments and empirical 
transforms. More specifically, suppose A = 1 is known and service time 
data dj^ , . . . ,dn are collected. The empirical Laplace transform of the 
serv'ice time distribution is 

n -sd: 

^s(s) = i: e ' (47) 

i=l 

is estimated by 



V\ rsT' — 



Ad^ 



2(1 - p) 



(4S) 



where 



d = ^ Z d, ; 

i=l 



(49) 



= h Z d, 

i=l 



(50) 



and 



p = A d 



(51) 



The empirical Laplace transform of the service times and the moment 
estimator of p, p, can be used in formulas (2) -(4) to obtain an estimate 
of V’vv(^)- This estimate, together with W can be used in the 

approximations to obtain estimates of E[W(t)] . 

Tables 6-8 report results of simulation experiments to study the 
behavior of the estimates. Each simulation has 1000 replications. Each 
replication supposes a sample of 100 service times. The random numbers 
were generated using LLRANDOMII random number package, see Lewis and Uribe 
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T ab 1 e 6 



Moments of Es1: images of E[U^ 
for 

M/M/1 Queue with 
A = 1 E[S] = 0.9 



T i me 


T rue 


Exponent i al 


Heav\' 


T raf f i c 


t 


E[WJ 


Approx i mat ion 


Approx i mat ion 






Mean 


\'ar i ance 


Mean 


\’ar i ance 


6 . 5 


1 .9 


1 .8 


0.1 


2.0 


0 . 1 


32.4 


4.2 


4.3 


2.0 


4.5 


2.4 


97.2 


5.9 


6.8 


14.0 


7.1 


15.6 


162.0 


6.7 


8.3 


33.1 


8.6 


35.9 


486 . 0 


7.9 


13.0 


210.6 


13.2 


218.5 


648 . 0 


8.0 


14 . 7 


347.6 


14.9 


357 . 5 



Table 7 

Moments of Estimates of E 
M/G/1 Queue 
A = 1 E[S] = 0.5 
Gamma Service Times 
Shape = 0.2 Scale = 2.5 



T i me 


T rue 


Exponent i a 1 


Heavy 


T raff i c 


t 


E[WJ 


Approx imat ion 


Approx i mat ion 






Mean 


\'ar i ance 


Mean 


\'ar i ance 


0.3 


0 . 13 


0.12 


0.001 


0 . 13 


.001 


1 .8 


0.53 


0.51 


0.024 


0.56 


.03 


3.0 


0.71 


0.70 


0.058 


0.78 


.08 


4.8 


0.90 


0.91 


0.13 


1 .0 


. 17 


CO 

o 


1 .2 


1 .2 


0.33 


1 .3 


.44 


24.0 


1 .4 


1 .6 


1 .0 


1 .6 


1 .2 
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Table 8 



Moments of Estimates of E [W^] 
M/G/1 Queue 
A = 1 , E[S] = 1 .5 
Gamma Service Times 
Shape = 0.2 Scale = 7.5 



T ime 
t 


True 

E[W,] 


Exponent i al 
Approximat ion 


Heavy Traffic 
Approximat ion 






Mean 


Var i ance 


Mean 


Var i ance 


1 .6 


3.9 


1 .9 


0.30 


2.0 


.31 


8.1 


7.5 


7.3 


6.7 


8.1 


7 . 6 


54.0 


34.0 


34.5 


256.8 


36.8 


277.7 


162.0 


89.1 


90.1 


2436.0 


92.9 


2488.0 


324.0 


170.2 


171.3 


10,210 


174.3 


10.296 


(19S1) . If the true 


ave rage 


service time is close to 1, then it is 


clearly possible for 


the samp 


le traffic 


i nt ens i ty 


p to be 


less than 


greater than 1 . If P 


is 1 ess 


than 1 , th 


en the estimate using the 


approximation for the 


stable 


queue is computed. 


If p > 1 , 


then the 


estimate using the approximation for the 


unstab 1 e 


queue is 


computed 



choice appears to be natural unless other information is available, or 
more assumptions are made. 

In Tables 6-8 are reported means and variances of the estimates of 
E [W^] for the estimates based on the exponential approximation and the 
heavy traffic approximation. 

In Table 6 results for a M/M/1 queue with E [S] = .90 are given. The 

sajne random numbers were used to compute the estimates for each of the 
times t. Of the 1000 replications, 137 had p > 1 and so the unstable 
queueing approximations were used in these cases. Doubtless it is the 
contribution of these cases that lead to the pronounced over estimate of 
the mean . 
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In Table 7 are reporred results for an M/G/l queue with A = 1 and 
gamma service times with E [5] = .5 having shape parameter .2 and scale 

parameter 2.5. None of the 1000 replications has p > 1. 

In Table S are reported moments for the estimates of E [W^] for an 
unstable M/G/l queue with A = 1 and gaimma service times with shape 
parameter 0.2 and scale parameter 7.5 and E [S] = 1.5. Of the 1000 

replications p > 1 for 938. of them. The true values of E[W^] in all the 
tables are from Middleton (1979). 

The means of the heavy traffic approximation are larger than those for 
the exponential approximation. The variances increase as t increases. 

The ve r\' large variances in Tables 6 and 8 are attributable to those 
estimates of E for which p > 1. 

In order to put the large x'ariances of Table 8 into perspect:\e, 
consider the following approximation. 

As a first approximation, if AE [S] > 1. then E [W^] ^ (AE[S] - l)t 

which can be estimated using the mean of the service times 

m(t) = (Ad - l)t . 



The variance of m(t) for a sample size of 100 is 



\’ar [m ( t ) j 



, 2 \^ar rS') 2 
^ “100 ^ 



In the case of a gamirna service time distribution with shape parameter 0.2 
and scale parameter 7.5, A = 1, t = 162 

Var[m(t)] = 2952.5 . 



Comparing this number to the corresponding variance of the estimate in 
Table 8 of 2436 indicates that the latter variance is not unreasonable. 
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The means of the estimates in Table 7 are close to the theoretical 
values in this stable queue. The means of the estimates in Table 6 are 
close to the theoretical values for the smaller t's. For larger t the 
means are greater than the theoretical values owing to those replications 
for wh i ch p > 1 . 

The means of the estimates in the unstable queue case of Table 8 are 
close to the true values of E[W^] except for the smallest time, t = 1.6. 
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9. CONCLUSIONS 



This paper proposes an eas i 1 y- compur ed approximation to the finite- 
time expected waiting time for an M/G/1 system starting from an empty 
condition. Both unsaturated (p < 1) and saturated (p > 1) conditions are 
considered. Numerical evidence is presented to indicate that the quality 
of the approximation is usefully good, especially when ease of computation 
is an issue. Further, the. methodology is adapted to assess expected 
waiting time when inferences must be made from a random sample of service 
times, and the decision is made to do so nonparatmet r i cal 1 y , i.e. without 
fitting a specific function. The results appear reasonable and 
potentially useful, and are not burdensome to obtain. The methodology 
investigated can also be appliea to the variety of queueing models that 
are close siblings of M/G/1: priority and breakdowns and ’’vacations'* 

being examples. Of course other approximating and inferential options 
remain to be investigated. 
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